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ABSTRACT 


Selected  recent  developments  in  chance-constrained  programming 
both  published,  unpublished  and  new,  are  presented  in  a  framework 
which  unifies  the  many  variants  of  probabilistic  programming  under 
the  rubric  of  chance-constrained  programming.  Developments  pre¬ 
sented  range  from  two  stage  linear  programming  under  uncertainty, 
through  acceptance  region  theory,  and  cross  cjiance-constrained  games. 


1.  The  Origins  of  Chance-Constrained  Programming 

The  fundamentals  of  chance-constrained  programming  (CCP)  are 
now  nearly  two  decades  old.  During  this  time,  theoretical  research  and 
practical  applications  have  clarified  and  strengthened  the  original  ideas, 
injected  new  insights  into  the  meaning  of  chance  constraints,  and  led  to 
the  development  of  important  new  classes  of  probabilistic  programming 
models.  Regretably,  this  development  has  been  accompanied  by  a  pro¬ 
liferation  of  terminology,  symbology  and  essentially  equivalent  model 
formulations.  Consequently  few  attempts  have  been  made  at  presenting 
a  unified  summary  of  CCP  results.  In  the  remainder  of  this  paper  we 
present  a  summary  of  the  most  significant  recent  results.  First,  however,  we 
recall  the  circumstances  surrounding  CCP's  original  development. 

CCP  was  originated  by  Charnes,  Cooper  and  Symonds  [59]  in  the  context 
of  developing  a  planning  and  operations  model  for  Standard  Oil  of  New  Jersey 
for  the  scheduling  of  heating  oil  manufacture,  storage  and  distribution  with 
weather -dependent  demand.  Initially  the  situation  was  modeled  as  a  con¬ 
strained  game  against  nature  [46].  The  constrained  game  approach,  however, 
was  not  entirely  satisfactory.  While  the  constraints  on  the  permissible 
strategies  of  nature  were  substantially  better  than  none  at  aP,  the  ’’clair¬ 
voyant  malevolence"  of  nature  implicit  in  the  minimax  solution  did  not  seem 
appropriate  to  the  behaviour  of  weather. 
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Ar.other  important  consideration  was  that  while  the  policy  of  the 
company  as  the  major  supplier  of  a  product  of  national  importance  wan 
to  supply  all  emergent  demand,  one  could  find  random  considerations  of 
weather  whose  associated  demand  would  be  impossible  for  the  company  to 
meet  from  its  available  resources.  Indeed,  it  was  discovered  on  further 
investigation  that  several  incidents  had  actually  occurred  in  the  past  in 
which  the  company  could  not  meet  the  demand.  On  these  occasions,  extra¬ 
ordinary  measures,  outside  the  company's  control,  had  to  be  taken  to 
alleviate  the  crises, 

A  model  was  therefore  sought  which  (a)  did  not  place  nature  in  the  role 
of  a  clairvoyant  malevolent  competitor,  (b)  would  express  a  "policy"  as  a  rule 
which  was  to  hold  almost  all,  but  not  all,  the  time,  and  (c)  would  develop 
a  plan  and  an  operationally  implementable  procedure  for  "most",  but  not  all 
randomly  emergent  situations.  These  challenges  chance-constrained  pro¬ 
gramming  met  through  (a)  representation  of  nature  more  classically  via 
joint  probability  distributions,  (b)  representation  of  a  "policy"  as  a  "chance 
constraint,"  and  (c)  posing  the  problem  of  chance-constrained  programming 
as  determining  from  a  preassigned  admissible  class  a  vector  of  stochastic 
decision  rules  which  would  satisfy  the  change  constraints  and  optimize  the 
expected  value  of  a  preassigned  functional. 

It  is  clear  that  within  these  prescriptions  chance -constrained  pro¬ 
gramming  may  be  considered  a  method  of  tremendous  flexibility  with  innumcr- 
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able  individual  possible  variations  or  models.  A  chance  constraint,  e.g., 
the  requirement  that  a  given  function  of  the  sought  vector  satisfy  a  given 
condition  to  at  least  a  prescribed  level  of  probability,  admits  as  many 
interpretations  as  does  the  probability  operator,  e.g.,  total  or  conditional, 
etc.  Again,  where  a  system  of  constraints  is  desired  to  hold,  chance  constraints 
may  be  imposed  individually  on  the  members  of  the  system  ("individual 
chance  constaints")  or  jointly  ("joint  chance  constraints").  One  might  employ 
functionals  ranging  from  minimization  of  expected  costs  to  maximization 
of  the  probability  of  some  event.  Additionally,  the  preassigned  class  of 
admissible  stochastic  decision  rules,  which  represent  the  operational 
prescriptions  of  the  model,  can  range  from  preset  parameters  to  be  deter¬ 
mined  ("zero-order  decision  rules")  to  the  most  general  class  of  "infor¬ 
mationally  feasible"  measurable  functions  of  sample  points  of  the  random 
variables,  and,  non-ope rationally,  to  "clairvoyant"  rules.  In  any  particular 
situation  to  be  modeled,  of  course,  the  choice  is  in  the  hands  of  the  statis¬ 
tician  to  select  the  blend  of  representation  of  the  real  features  of  the  situa¬ 
tion  with  an  effectively  operable  and  analyz«.ble  structure. 

From  the  work  of  Charnes,  Cooper  and  Symonds  it  was  immediately 
appart-nl  that  the  CCP  '>pp*'co.ch  h^ld  potentially  great  applicability  to  a  far 
wider  class  of  problems  than  those  of  scheduling  the  production  of  heating 
oil.  Thus,  theoretical  work  continued  in  parallel  with  the  original  application 
effort  in  order  to  establish  the  beginnings  of  a  framework  for  future  theoretical 
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developments  as  well  as  additional  applications,  (see  [2]  for  an  example 
of  early  results  of  such  work).  Since  these  beginnings,  interest  in  CCP 
has  mushroomed  and  the  list  of  individuals  making  contributions  grows 
longer  annually. 

To  illustrate  more  concretely  the  nature  of  the  opportunities  and  the 
difficulties  of  chance -constrained  programming,  we  turn  now  to  a  mathe¬ 
matical  representation  of  the  problem  of  CCP, 

2,  Definition  of  Chance -Constrained  Programming 

The  CCP  literature  contains  a  wide  variety  of  differing  formulations 
of  varying  degrees  of  generality.  All  these  formulations,  however,  possess 
several  common  ingredients,  including  decision  rules  which  must  be  selected 
from  some  prescribed  class,  an  extremization  objective  function,  linear 
or  nonlinear  constraints  of  the  conventional  deterministic  type,  and  chance 
constraints  which  stipulate  that  certain  relations  (equations  or  inequalities) 
between  various  random  variables  and  the  decision  rules  must  be  satisfied 
with  at  least  a  specified  level  of  probability. 

In  order  to  state  the  CCP  problem  in  a  typical  but  general  form  we 
reproduce  here  the  CCP  problem  as  first  presented  in  [10],  Virtually  every 
formulation  in  the  literature  can  be  obtained  by  considering  various  special 
cases  of  this  problem. 
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We  use  b  =  (b  .  .  b  )  to  denote  a  vector  of  random  variables 
l  m 

b  ,  i  =  1.  .  .  m  with  a  known  joint  distribution  function, 

i 

F(t)  =  F(t  ,  .  .  .,  t  )  =  P(  b.  i  *  1,  .  .  ,,  ml. 

1  m  ii 

From  its  definition  F  is  right  continuous.  The  subset  of  m  space  which 
is  the  range  of  the  random  vector  b  will  be  denoted  fi  .  The  operators  P 
and  E  will  denote  respectively  probability  and  expectation  integrals;  these 
are  to  be  evaluated  with  respect  to  the  Lebesgue -Stieltjes  measure  (also 
denoted  by  F)  induced  by  the  function  F.  The  letter  a  will  denote  throughout 
a  given,  fixed  real  number  such  that  0  <  a  si. 

For  any  univariate  distribution  function  C.,  the  afractile  of  C>  is  given  by 
G  =  inf{s:  G(s)  2  a). 

Thus,  in  general,  G  *(G(t))  s  t  and  G(G  1(a))  2  a,  but  if  G  is  continuous  at 
G  ^(a)  then  G(G~l(a))  =  a. 

A  decision  rule  (or  rule)  x(t),  where  X:  Rn,  is  a  vector  function 

which  is  a  member  of  some  prescribed  nonempty  subclass  C  of  the  Lebesgue 
measurable  functions.  Examples  of  the  class  C  which  we  will  consider  are' 

(a)  Cq  =  [x:  x(t)  =  Xq  for  all  t],  the  class  of  constant  or  zero-order 
rules. 

(b)  Cj^  =  (x:  x(t)  =  Dt  +  d,  where  Dismx  n,  d  is  m  x  l},  the  class 
of  linear  orfirst  order  rules. 

(c)  or  Cp^  or  Cp^,  the  class  of  measurable  or  piecewise  analyu*.. 


or  piecewise  linear  rules,  respectively. 


(d)  Ck  =  £ x :  x.(t),  the  i-th  component  of  x,  is  an  arbitrary  measur¬ 
able  function  of  t t  ,  some  j.,  and  a  constant  function  of  t  for 

1  h  1  .1 

J  >  the  class  of  k-stage  or  k -order  rules. 

Note  that  if  j,  =  0  for  all  i  then  C  =  C  ,  while  if  j  -  m  for  all  i  then 
1  k  0  l 


For  our  purposes,  the  interpretation  of  a  decision  rule  is  that  x(b) 
represents  a  decision  which  will  be  taken  as  a  function  of  the  random 
variable  in  b.  In  [33,  34]  the  class  of  clairvoyant  decision  rules,  in  which 
the  decision  rule  is  permitted  to  be  a  function  of  all  the  random  variables 
involved  in  the  model,  was  introduced.  This  class  of  rules  is  important 
for  in  principle  evaluation  of  the  importance  (or  value)  of  information  and  in 
obtaining  bounds  on  the  optimal  value  of  the  objective  function.  The  chance - 
constrained  programming  problem  with  clairvoyant  decisicn  rules  contains 
as  a  special  case  the  stochastic  linear  programming  models  of  Tintner 
[55,  56  j.  The  special  case  results  from  the  fact  that  the  chance  constrained 
formulation  also  admits  constraints  which  are  required  to  hold  onlv  with 
probability  at  least  a  <  1,  whereas  the  constraints  of  stochastic  linear 
programming  are  required  to  hold  with  probability  one. 

The  extreme  opposite  class  of  decision  rules,  in  terms  of  the  amount 
of  information  which  is  employed  by  the  decision  maker  in  the  decision  rul". 
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mathematical  functions  of  the  random  variables  are  involved  in  the  rules. 

In  informational  terms,  the  class  of  rules  x(t)  :  x^  for  all  t  might  better 
be  called. the  Hass- of  "non -adaptive"  rules.  Decision  rules  classes 
intermediate  between  the  "non-adaptive"  and  "clairvoyant"  classes  permit 
adaptation  in  response  to  observed  values  of  the  random  variables. 

When  information  (observed  sample  values  of  the  random  variable  1 

becomes  available  stage -by-stage ,C  ,  the  class  of  k  stage  rules,  may 

correspond  in  informational  terms  to  the  class  of  informationally  feas  ole 

rules.  In  [17,  18,  19]  such  rules  have  been  considered  in  'he  context  ■  >{ 

n  period  models  in  which  the  decision  rule  for  the  k^1  period  is  permit  ed 

to  be  a  variable  function  of  the  random  variables  of  periods  1  to  k-1,  but  must 

be  a  constant  function  of  the  random  variables  of  the  k*^1  and  future  pe  dobs, 
t  h 

Thus,  the  k  period  decision  is  taken  in  response  to  all  information  available 
then  e.g.  the  observed  values  of  the  random  variables  of  periods  1  to  k-1 
and  in  anticipation  of  values  which  may  arise  for  the  random  variables  in 
periods  k  through  n.  One  may  consider  the  informationally  feasible  rules, 
and  all  other  n  period  rules  in  which  less  information  is  used,  to  be  non- 
randomized  rui^s  in  the  sense  that  we  require  the  decision  x(b)  to  be  deter¬ 
mined  once  the  appropriate  random  variables  have  been  observed.  Randomized 
rules  can  of  course  be  comprehended  under  this  rubric  by  the  device  that 
the  randomization  at  ach  stage  can  bo  considered  as  realized  by  random 
drawing  or  sampling  of  other  random  variables  prior  to  the  onset  of  this 


stage. 
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Within  the  above  framework  we  define  the  chance -constrained  pro¬ 
gramming  problem  as  follows: 

Select,  if  one  exists,  a  decision  rule  x(b)  with  x  €  C  which  yields  an 
infimum  to 

Ef(x(b),l>) 

subject  to 

Pig  (x(b).b)  H]  M  .}  -  1,  ....  J  (1) 

J 

and 

x(b)  e  K  with  probability  one  (w.  p.l). 


In  (1),  the  functions  f,  g  are  assumed  to  be  Horel  measurab1-.  and  to 

J 

be  such  that  f:  Kn  x  Rm  -♦  R  1  and  g  :  Rn  x  Rm-»  Hm  Tne  set  K  is  assumed 

J  J 

to  be  some  nonempty  submit  of  Rn. 

Example  1  Take  C  r  C.  (with  k  =  2)  and  i  *  0  for  i  ~  1.  .  .  n.  and 
- c -  k  Ji  1 

.),  =  m  for  i  =  n  +  1,  .  .  n.  Then 

x(t)  :  [x  ,  .  .  . ,  x  ,  y ,  (t >,  .  .  .  ,  y  <t )] . 

1  nj  i  n-n^ 

Let 


and  set 


K  =  i(x,  y (t ))  :  Dx  2  ri,  x  >  0,  y(t)  2  0} 


f(x(b),b)  =  c^x  +  c^y(b) 
for  fixed  vectors  and  c  . 


j 
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Let  J  1  2  and  let  g  =  Ax  +  My(b)  -  b  =  -g  .  Let  a  =  a  r  1. 

*1  2  12 

Then  (1)  becomes  the  two-stage  linear  programming  under  uncertainty 
problem: 

min  CjX  +  Ec2y(b) 

Dx  ^  d,  x  >  0  (2) 

subject  to 

Ax  +  My(b)  r  b,  y(b)  ^  0  w.  p.  1. 


Example  2:  Use  the  same  choice  of  C  as  in  Example  1,  and  take 

b  =  (b1,  b2)  where  b1  =  (b.,  .  .  b  ),  b2  =  (b  b_)  so  that 

i  m  m  +  i  m 

x(b)  =  (x,  y (b 1 )).  Choose  K  =  ((x,y):  x  2  0}.  Choose  J  =  m  +  (n  -  nj). 

Let  m  =  1  for  all  j  *  1,  .  .  . ,  J.  Let  g.  =  X  -  b  ,  j  5  1,  .  .  . ,  m; 

gJ  =  A21X  +  A22Y^b^  ‘  bj*  J  =  ni  +  •  •  •  .  rh,  gj  =  Y  -  (bl)>  J  =  rn  + 

m  +  (n  -  n^);  where  the  superscript  j  denotes  the  j-th  row  of  the  matrix. 

Let  f  =  CjX  +  CgYfb  )  for  fixed  vectors  C^  and  C^.  Problem  (1)  then 
becomes 

min  CjX  +  EC2Y(b1) 

subject  to 


and 


P(AJ  X  2  b  )  2  a  , 
11  J  J 

P(AJ  X  +  Aj  Y (b 1 )  2  a  , 

21  22  J 

P(Y(b  }  2  0)  2  a  . 
j-m  J 


1  =  i,  .  .  . ,  m, 
j  =  m  +  1,  .  .  .  ,  m 

j  =  rh  +1,  ..  n. 


This  is  the  two-stage  E  model  of  chance -constrained  programming. 

If  we  interpret  the  P  operation  in  the  constraints  of  (3)  to  be  a  total 
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probability  operator,  then  we  get  the  chance  constrained  model  with  total 

probability  constraints  [see  8, IS),  22],  If  we  interpret  P  to  mean  that  we 

2  1 

compute  the  probability  using  the  conditional  distribution  of  b  given  b 
then  we  get  the  chance  constrained  model  with  conditional  probability  con¬ 
straints  [see  17,  33,  34], 


Example  3:  If  we  use  the  same  functions  as  in  Example  2,  but  re¬ 

define  f  to  be  equal  to  1  if  CjX  +  c^yfb*)  a;  Lq  and  0  otherwise,  for  some 
prescribed  L^,  we  obtain  the  P-model  objective  of  chance-constrained  pro¬ 
gramming  namely, 

min  PCCjX  +  C^Yfb1)  *  Lq]. 

P  models  have  been  discussed  in  [8,  35], 


1  1  ‘ 

Example  4:  If  we  now  define  f  to  be  the  function  [C2Y(b  )  -  EfC^Yib  ))] 

then  the  objective  becomes  that  of  the  V  model  of  chance-constrained  pro¬ 
gramming  [6],  namely, 


min  var[CjX  +  C^Yib  )], 


Example  5:  If  we  consider  the  case  of  (1)  in  which  J  =  l,  but  in  which 

rrij  is  not  necessarily  equal  to  one,  the  chance  constraint  becomes 
P(g.(x(b),  b)  a  0,  i  =  1,  .  .  m.3  2  a  , 

i  1 


whe  re 


„m  _n  ,  1 

g,:  R  x  R  -*  R  . 

Thus  we  obtain  a  joint  chance  constraint.  Models  with  joint  chance  constraints 


have  been  considered  in  several  recent  papers,  notably  [11,  13,  42,  43], 
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For  use  in  the  following  sections  we  write  here  some  nonlinear  and 

linear  joint  chance -constrained  problems  with  decision  rule  class  C  : 

M 


subject  to 


and 


min  Ef(x(b)) 
x(b)  e  K  w.  p.  1 

P{gj(x(b))  a  b,,  all  i  =  1,  .  .  m^}  ^  a  (4a) 


min  Ecx(b) 
x(b)  e  K  w.  p.  1 

subject  to 

PtAx(b)  a  b]  s  a  (4b) 

and 

x  c  C  . 

M 

Note  that  (4a)  is  specialized  to  the  extent  that  g.(x(b),  b)  is  written 

(with  slight  abuse  of  notation)  as  g  (x(b))  -  b  and  f  =  f(x(b)),  while  in  (4b), 

i  l 

g.(x(b),  b)  is  a1x(b)  -  b.,  where  a1  is  the  i-th  row  of  the  matrix  A. 

1  •  l 


Properties  of  Optimal  Decision  Rules 

In  recent  years,  considerable  effort  has  been  devoted  to  establishing 
properties  of  optimal  decision  rules  for  various  probabilistic  programming 
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models,  but  particularly  for  the  two  stage  and  n-stage  models  described 
in  Examples  1  and  2  above.  Results  on  the  two  stage  linear  programming 
under  uncertainty  problem  (Example  1)  can  be  found  in  [49,  51  ,  52  ,  53,  54  ], 
These  results  show  that  the  two  stage  problem  can  be  rewritten  in  the  form 
of  an  equivalent  deterministic  convex  nonlinear  programming  problem. 

Several  such  deterministic  equivalents  have  been  established  and  algorithms 
for  their  solution  have  been,  or  are  being,  developed, 

A  major  issue  raised  by  the  two  stage  problem  involves  determining 
conditions  i+ider  which  the  second  stage  constraints 

My(b)  =  b  -  Ax 
y(b)  *  0 

are  consistent  for  all  possible  values  of  the  random  vector  b  and  all  first 
stage  decisions  x.  In  the  early  work  on  the  two  stage  problem  it  was  simply 
assumed  that  the  second  stage  constraints  were  consistent.  Subsequently 
Kail  [5  ]  established  the  following  result: 

KalEs  Theorem:  For  Ax  =  b  to  have  a  non-negative  solution  x  for  all 

b  g  Rm  it  is  necessary  and  sufficient  that  there  exist  Uj  &  0  and  <  0 
such  that 

m+k  m 

S  UjA.  =  2  X.  A. 

j=m+l  J  ^  j  =  l  •*  J 

where  A,  is  the  j-th  column  of  (m  +  k)  x  n  matrix  A  and  A.,  ....  A  are 
J  l  m 

linearly  independent, 

A  stronger  result,  which  we  have  presented  for  some  years  in  our  classes 
but  not  previously  published  in  the  literature,  is  the  following: 


Theorem 


A  necessary  and  sufficient  condition  that  Ax  =  b,  x  *  0  have  solutions 
for  in  linearly  independent  vectors  b^m\  and  their  negatives 

is  that  there  exist  non-negative  nx(m  +  k)  matrices  N+,  N  such  that 
AN+  =  I,  AN"  -  -I. 

Corollary 

Under  the  hypothesis  of  the  above  theorem,  non-negative  solution 
vectors  x  exist  for  all  vectors  b  e  Rm,  to  wit, 

x  =  N+  b+  +  N'  b" 

whe  re 

b-  =  1/2  {b+  jbj}. 

Solution  theorems  and  characterizations  of  the  optimal  decision  rules 
for  the  n-stage  chance-constrained  programming  problem  are  given  in 
(17,  18,  19].  For  the  two  stage  problem  (Example  ?)  with  the  class  of 
informationally  feasible  rules,  the  main  result  is  the  following: 

Theorem 

There  exists  an  optimal  vector  of  second  stage  decisions  y(b*)  which 
is  a  piecewise  linear  function  of  the  vector  of  conditional  fractile  points 
F  (1  -  ag)  and  the  vector  of  first  stage  decisions  x. 

More  useful  results  for  special  forms  of  A22  and  specific  distributions 
of  the  random  vector  b*  can  be  found  in  the  literature.  However,  an 
algorithm  for  finding  the  optimal  piecewise  linear  rule  does  not  exist  for 
the  general  two  stage  problem. 
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4,  Acceptance  Regions  in  Chance  Constrained  Programming 

In  section  1  we  noted  the  highly  desirable  aspects  of  chance-constraincd 
programming  in  allowing  one  to  formulate  plans  and  procedures  for  "most", 
but  not  all,  of  the  time,  where  the  precise  exceptional  situations  are  locked 
up  implicitly  in  the  problem  and  need  not  be  known  a  priori.  The  fact, 
however,  that  an  optimal  class  of  stochastic  decision  rules  is  determined 
on  the  viable  system  sample  points  (and  indeed  rigorous  specification  of 
the  problem  requires  explicit  consideration  of  the  unviable  or  "rejected" 
regions)  suggest  analogies  with  the  Neyman-Pearson  theory  of  testing 
statistical  hypotheses.  Thus  the  notion  of  "acceptance  regions"  for  chance 
constraints  has  recently  been  formulated  by  Charnes,  Kirby,  and  Raike  [10] 
and  applied  to  derive  essential  simplifications  in  chance -constrained  pro¬ 
gramming  theory,  particularly  in  the  more  recondite  areas  of  joint  and 
conditional  chance  constraints. 

To  introduce  the  concept  of  an  acceptance  region  we  proceed  as  follows: 

Let  g(x,  b) :  Rn  x  Rm-*  Rm*.  Let  x(t):  Rm-*  R  be  some  prescribed 
decision  rule  which  is  a  member  of  the  class  C. 

Definition  :  The  acceptance  region  for  the  chance  constraint 

P{g(x(b),  b)  a  0}  a  o.  under  the  decision  rule  x  is  defined  as 
Agfir)  =  {t  e  Rm:  g(JT(t),  t)  a  0}. 
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Definition  :  Let  V  (x)  -  {t  e  R  :  g(5T(t ),  t)  <  O}.  V  (y)  will  he* 

-  g  g 

termed  the  rejection  region  for  the  chance  constraint  Pt.g(x(b),  bl  2  0}  >  a 
under  the  decision  rule  x.  The  subscript  g  and  the  argument  7T  will  occasion¬ 
ally  be  suppressed  if  no  confusion  would  result. 

We  summarize  some  pertinent  and  elementary  observations  about  the 
rejection  and  acceptance  regions  in  the  form  of  a  lemma.  The  proof  is 
obvious  and  will  be  omitted. 


Lemma 


(a)  For  any  x  e  C,  V  (x)  and  A  (x)  are  measurable  sets. 

o  o 

(b)  A  (x)  =  V  c(x),  the  complement  of  V  (x). 

£  £  ® 

(c)  x  e  C  is  feasible  (i.e.,  x(b)  e  Kw.p.  1  and  p{g(x(b),  b)  2  0}  <:  a 

if.and  only  if,  Plb  e  V  (x)}  s  1  -  a.  or  equivalently  Pfb  e  A  (x) }  &  a, 

g  g 

x(b)  e  K  w.  p. 1. 


The  regions  V  (x)  and  A  (x)  are  thus  simply  the  sets  of  those  points  for 
g  g 

which  a  given  decision  rule  x  violates  or  satisfies,  respectively,  the  relation 


g  2  o. 


Before  proceeding  to  establish  properties  of  optimal  acceptance  and 
rejection  regions  for  (1),  we  make  the  following  two  assumptions  about  the 
functions  f,  and  gy  j  =  1,  .  .  .,  J  and  the  set  K. 


-16- 


Assumption:  The  functions  -  f(x,  t)  and  g.(x,t)  arc  assumed  to  be 

concave  and  twice  continuously  differentiable  functions  x  for  each  t  and  to 

be  continuous  as  functions  of  t.  The  set  K  is  assumed  to  be  defined  as 

K  =  [x;  hj(x)  so,  i  e  I } ,  where  the  h,  are  twice  continuously  differentiable 

concave  functions.  The  set  [x:  h.(x)  a  0,  g  (x,t)  £  0  for  all  i  and  j]  is  assumed 

i  J 

to  have  a  nonempty  interior  for  each  t.  The  set 

{x:  g.(x,  t)  *  0,  j  =  l,  .  .  . ,  J}  H  K  fl  {x:  f(x,  t)  £  u] 

J 

is  assumed  to  be  compact  for  all  constants  u. 


Assumption:  It  is  assumed  that  one  of  the  following  holds. 

(i)  For  each  t,  at  least  one  of  the  f,  or  -h^,  are  strictly  convex  functions. 
<ii )  Nonnegativity  constraints  are  present  for  all  variables. 

(iii)  There  are  n-independent  linear  constraints  present;  Note  that  (ii) 
is  a  special  case  of  (iii). 

Then,  if  (1)  is  "regularized",  the  following  result  can  be  established  1 10): 
Theore  HI 


Let  A  =  {A.,  j  =  1,  .  .  J }  be  any  collection  of  measurable  sets.  Then 

J 

there  exists  a  measurable  rule  for  (1)  such  that  x^*(b)  e  K  w,  p.  1  and 

A„  ( x a  * )  3  A  for  each  j,  and  such  that  f(xA*(b),  b)  £  f(x(b),  b)  a.e.  for  all 
gj  A  j  A 

measurable  x  having  A  (x)  -^A  for  each  j  and  x(b)  e  K  w.  p.  1. 


As  a  direct  result  of  this  theorem  we  have  the  following: 
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If  there  exists  a  rule  x  e  which  is  feasible  and  optimal  in  the 
class  for  (1),  then  for  some  A  =  lAp  .  .  .,  A^}  the  rule  *A*(t)  is 
also  feasible  and  optimal  for  (1). 


The  importance  of  this  corollary  is  that  it  says  that  if  an  optimal  rule 

exists  for  (1),  then  x  (t)  given  by  the  above  Theorem  is  also  an  optimal 

A  ^ 

rule  for  (1)  for  some  set  of  acceptance  regions  A^,  J  =  1 ,  .  .  .  ,  J.  This 
means  we  can  view  (1)  as  a  problem  of  finding  an  optimal  set  cf  acceptance 
regions  rather  than  an  optimal  rule.  Thus  we  have  the  following  important 
result: 


Theorem 

Suppose  that  there  exists  an  optimal  rule  for  (1)  with  C  =  C^.  Then 
under  A1-A3,  (1)  may  be  replaced  by  the  equivalent  problem. 


Find  an  A  =  [Aj, 


subject  to 


with  each  A  measurable  which  vields 
J 


min  Ef(x  *<b),  b) 

A  A 

(5) 


Plb  e  Aj)  i  a  ,  j  s  1,  ...»  J. 

J  J 


Any  A  which  yields  a  minimum  in  (5)  will  be  termed  a  collection  of 
optimal  acceptance  regions.  Thus,  we  may  speak  freely  and  interchangeably 
about  either  optimal  rules  for  (1)  or  optimal  (acceptance)  regions  in  (5). 


-18- 


In  (10,  42,  43]  it  is  shown  how  the  latter  may  be  used  to  advantage  in 
characterizing  optimal  classes  of  decision  rules  for  certain  problems, 
and  in  constructing  explicit  solutions  to  others.  These  results  are  parti¬ 
cularly  useful  in  problems  which  have  only  a  single  chance  constraint  or 
in  which  all  the  random  variables  involved  in  the  problem  are  discrete. 


5.  Chance-Constrained  Programming  and  Games  with  Random  Payoff  Matrices 
We  define  a  two  person,  zero  sum  random  payoff  game  to  be  a  two 
person  game  in  which  the  elements  a.,  of  the  mxn  payoff  matrix  A  are 

*J 

random  variables.  We  assume  that  the  distribution  function  G  of  the 
matrix  A  is  known;  the  distribution  of  each  a_  is  the  appropriate 
marginal  distribution. 

If  player  I  plays  row  i  and  player  II  plays  column  j,  the  payoff  from 
player  II  to  player  I  is  determined  by  observing  the  random  variable  a^. 

In  particular  the  actual  payoff  on  any  play  of  the  game  will  be  a.Tw)  where 
w  is  selected  from  the  domain  of  a  according  to  the  known  probability 

ij 

distribution  of  aip. 

m 

Let  X  =  (x,,  x9,  .  .  .,  x  ),  where  E  x.  =  1,  x.  a  0,  be  a  mixed 
l  *  m  i=l  1  i 

n 

strategy  for  player  I.  Let  Y  =  (yt,  y„,  .  .  . ,  y  ),  where  £  y  =  1, 

1  1  n  j=l  1 

y .  *  0,  be  a  mixed  strategy  for  player  II.  Let  Z(X,Y)  be  the  observed 
J 

payoff  when  player  I  and  player  II  use  mixed  strategies  X  and  Y  respectively. 


Let  u,  v  be  independent  random  variables  such  that  P(u  =  l)  =  x^  i  =  1,  2,.  .  .m 
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and  P<v=j)  =  yj  j  =  1,  2,  .  .  . ,  n;  and  u  and  v  are  independent  of  the 

random  variables  a  for  every  i  and  j.  Player  I  plays  according  to  the 
ij 

sample  value  of  the  random  variable  u  and  player  II  according  to  that  of 

v  with  each  player  unaware  of  the  sample  his  opponent  draws.  Then  if 

u=i  and  v=j,  the  payoff  is  given  by  the  random  variable  a.^.  It  is  then 

straightforward  to  verify  that  Z(X,Y)  has  the  following  distribution 

m  n 


P(Z(X,  Y )  <  t)  =  2  2  P(a.,  <t)  x.y 
i  =  l  j  =  l  1J  1  J 

We  assume  that  both  players  know  the  distribution  function  G  of  the 
payoff  matrix  A. 

One  criterion  for  optimization  is  as  follows: 

Player  I  assigns  a  weight  w(0)  to  each  0  in  the  range  of  payoff  levels 

„62 

[ S 1 ,  such  that  J  w(t)  dt  =  1.  The  weight  w(0)  indicates  the  importance 
player  I  attaches  to  each  payoff  0  in  the  interval  [£.,  g  ].  Thus  player  1 
chooses  the  mixed  strategy,  X*,  which  maximizes  the  weighted  average 
of  the  probability  of  his  obtaining  a  payoff  level  at  least  0  e  [  3  ^ ^  no 
matter  what  strategy  player  II  uses.  Mathematically,  the  problem  player  I 
wants  to  solve  is: 


max  min  f  P(Z(X,  Y )  &  t)  w(t)dt  =  min  f  P(Z(X*,  Y  )  >  t )  w(t  hit. 
X  V  j9,  V  S, 


It  can  be  shown  that  this  problem  reduces  to  the  following  linear  program: 
max  a 

X  m  @2 

such  that  2  x.  [  f  P(a  ^  t)  w(t)  dt]  2  ~  for  every  i 

i=i  1  JSl  « 

m 

2  X.  =  1,  x.  a  0 

i  =  l  1  1 


for  every  i 


(6) 
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In  the  special  ease  where  we  define  w(t)  to  be  the  Iiirac delta 

function  with  mass  point  at  g,  problem  (6)  reduces  to  that  of  finding  the 

optimal  strategy  for  player  I  in  the  deterministic  game  with  payoff  matrix 

[P(a  2g). 

U 

Suppose  now  that  rather  than  using  the  optimality  criterion  of  (6) 
player  I  wants  to  maximize  his  payoff  level  g,  subject  to  the  constraint 
that  he  achieve  the  payoff  level  0  with  at  least  a  prescribed  probability  a, 
no  matter  what  strategy  his  opponent  uses.  We  suppose  a  >  0  since  other¬ 
wise  the  problem  is  unbounded.  This  problem  can  be  expressed  mathe¬ 
matically  as: 

max  g 

such  that  min  (P(Z(X,Y)  a  3)  a  a  (7) 

Y 

which  is  equivalent  to: 

max  0 

m 

such  that  £  x.  P(a  *  |3)  a  a  for  every  j  (8) 

i  =  l  1  ij 

m 

£  x.  =  1 

i  =  l  1 

y  a  0  for  everv  i 

1 

where  a  is  given  constant  0  <  a  s  1. 


Because  of  the  form  of  the  constraints  of  (8)  the  problem  is  not  only 
nonlinear  in  the  variables  x,  (i  =  l,  2,  ....  m)  and  3 but  also  the  region 
of  feasible  solutions  may  not  form  a  convex  set.  Despite  the  problems  of 
nonconvexity,  an  algorithm  for  the  solution  of  (8)  is  given  in  [58). 

In  papers  now  in  preparation,  various  results  are  developed  for  models 
in  which: 

(a)  The  players  have  no  information  about  the  distribution  function 
F(A)  of  the  random  matrix  A. 

(b)  The  players  have  a  partial  ordering  on  the  probabilities  of  the 
states  of  nature  of  A. 

(c)  The  players  know  bounds  on  the  probabilities  of  the  various 

states  of  nature.  That  is,  the  players  know  that  a  s  p(k)  £  b  where 

k  k 

a  ,  b  are  given,  k  =  1,  2,  .  .  .  ,  K. 
k  k 

(d)  The  players  have  complete  information  about  the  distribution  F(A). 
In  addition,  models  are  being  developed  which  involve  other  optimality 

criteria  and  in  which  additional  constraints  are  placed  on  the  possible  stra¬ 
tegies  of  the  players.  These  latter  models  are  extensions  to  random  payoff 
games  of  the  original  work  of  Charnes  [56)  on  constrained  deterministic 
zero  sum  games. 
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